Author
|
Topic: AntiPolygraph.org
|
J.B. McCloughan Administrator
|
posted 10-25-2002 07:45 PM
I had an idea today, with regards to the open discussions that are carried out on http://www.antipolygraph.org . I thought it might be of use for us to conduct mirrored discussions here on those meaningful topics posted on their site. Some benefits from this may be:1. It could allow us to collaborate on the best conceivable answers to certain questions that arise there and may be in future more important settings. 2. It could allow us to plan actions or counter-actions for perceived future ventures they may be planning or have announced. 3. It may equip us with the best countermeasure information. Often discussions contain information on countermeasures, even when the topic is not of that area. Those who have ever participated in discussions or discourses on the aforementioned sited have most likely been subject to a barrage of questions and challenges to assertions that seem almost rehearsed. It is my belief that it seems this way because the dialogue is often just that on the anti-polygraph side, rehearsed. Maschke has quite an elaborate backdoor discussion group. Topics are collaboratively discussed in these groups. Other posters on antipolygraph collaborate to attempt to draw discussion or discourse on a topic. The fact is that the main characters on the antipolygraph are well educated, articulate, and organized. Anyway, it is just an idea for thought.
IP: Logged |
egelb Member
|
posted 10-26-2002 05:45 PM
I thnk J.B. has a great idea. The anti forums are widely read and quoted. We should know what our detractors are saying. I for one would be wiling to address the issues raised assuming they do not hack in and use our informtion against us. The lack of a strong response to the NAS report hurts those usng "screening exams" and that spills over to nonscreening users too. Feel free to quote our detractors and lets see if this board can come up with sensible replies. Ed GelbIP: Logged |
J.B. McCloughan Administrator
|
posted 10-26-2002 07:09 PM
I think this may be as good as any to start with.On http://www.antipolygraph.orgGeorge Maschke wrote: quote:
Re: NAS Polygraph Report « Reply #41 on: 10/10/02 at 04:44:07 » -------------------------------------------------------------------------------- What the NAS Report Says About the Accuracy of Specific-Incident Polygraph Testing The following is an excerpt from the conclusions of the NAS polygraph report (p. 168 of the HTML version): Quote:Estimate of Accuracy Notwithstanding the limitations of the quality of the empirical research and the limited ability to generalize to real-world settings, we conclude that in populations of examinees such as those represented in the polygraph research literature, untrained in countermeasures, specific-incident polygraph tests for event-specific investigations can discriminate lying from truth telling at rates well above chance, though well below perfection. Accuracy may be highly variable across situations. The evidence does not allow any precise quantitative estimate of polygraph accuracy or provide confidence that accuracy is stable across personality types, sociodemographic groups, psychological and medical conditions, examiner and examinee expectancies, or ways of administering the test and selecting questions. In particular, the evidence does not provide confidence that polygraph accuracy is robust against potential countermeasures. There is essentially no evidence on the incremental validity of polygraph testing, that is, its ability to add predictive value to that which can be achieved by other methods.
Note that:
1) This estimate of accuracy does not specify what kind of polygraph tests, e.g., CQT vs. R/I vs. GKT "can discriminate lying from truth telling at rates well above chance." 2) The authors' conclusion that polygraph tests "can discriminate lying from truth telling at rates well above chance" is conditioned upon the subject population being similar to "those represented in the polygraph research literature," that is, ignorant of polygraph procedure and countermeasures. Such ignorance cannot be safely assumed, especially with information on both polygraph procedure and countermeasures readily available via the Internet. 3) If the authors' conclusion that "the evidence does not allow any precise quantitative estimate of polygraph accuracy..." is correct, then it (a fortiori) follows that software algorithms peddled by polygraph manufacturers such as Axciton and Stoelting that purport to determine with mathematical precision the probability that a particular individual is lying or telling the truth are worthless. 4) The authors conclude that "the evidence does not provide confidence that polygraph accuracy is robust against potential countermeasures." It is not safe to assume that anyone passing a polygraph "test" has told the truth. 5) The last sentence of the above-cited paragraph is the key one with regard to polygraph validity (as opposed to accuracy): "There is essentially no evidence on the incremental validity of polygraph testing, that is, its ability to add predictive value to that which can be achieved by other methods." What this means is that there is no evidence that polygraph "testing" provides greater predictive value than, say, interrogating a subject without the use of a polygraph, or with a colandar-wired-to-a-photocopier that is represented to the subject as being a lie detector. The NAS's conlusion that "specific-incident polygraph tests for event-specific investigations can discriminate lying from truth telling at rates well above chance, though well below perfection" with naive subject populations is hardly a vindication for the validity of CQT polygraphy, and those in the polygraph community are formally cautioned against publicly misrepresenting it as such, as you can expect to be publicly called out on it. « Last Edit: 10/11/02 at 05:57:11 by George W. Maschke » Logged
[This message has been edited by J.B. McCloughan (edited 10-26-2002).] IP: Logged |
J.B. McCloughan Administrator
|
posted 10-29-2002 12:06 AM
Let me be the first to attempt to contrive a reverse view of Mr. Maschke’s.1. Considering the wealth of research is found in specific issue testing using a Control/Comparison Question Test format and the focus of this study uses the same question format, one could quite easily infer that the NAS was generalizing about the polygraph when used in a SIT and using a CQT format. 2. The authors’ conclusions on that the polygraph "can discriminate lying from truth telling at rates well above chance" is made only in reference with those conditional variables present in the accepted studies reviewed. Being that the preponderance of the reviewed analog studies were conducted with college students, the polygraph research could indicate that the instrument and its procedures have well above chance accuracy with individuals of average and above average intelligence. Also, because the socialethnic diversity within these settings is considerably more than that which is found in an normal SIT field application, the polygraph might not diminish in its accuracy throughout the spectrum of cultures. 3. Although algorithms are in their infancy and perceivably will mature and evolve, such computer analysis of the vast amounts of confirmed chart data that has been collected in available research may provide useful insight into how polygraph can achieve greater accuracy. This task might also aid researchers in their establishment of a quantitative estimate of accuracy, through the collection of objective, quantifiable data under experimentally controlled conditions. 4. The NAS indicates that "the evidence does not provide confidence that polygraph accuracy is robust against potential countermeasures." This has become dually noted by the polygraph profession within the past five or so years, absent any outside analytical review. With the recent developments of information flow on countermeasures and other polygraph related material that was otherwise nonexistent in the past, new questions have come to light on how certain variables, that were rather unessential to those examiners outside the scope of the counterespionage realm, could possibly be effecting polygraph as a whole. Agreeably, only further research on this topic will provide any meaningful answers. 5. The NAS said, "There is essentially no evidence on the incremental validity of polygraph testing, that is, its ability to add predictive value to that which can be achieved by other methods." This could be mistaken in a negative connotation and purportedly prescribed as Mr. Maschke says, "What this means is that there is no evidence that polygraph "testing" provides greater predictive value than, say, interrogating a subject without the use of a polygraph, or with a colandar-wired-to-a-photocopier that is represented to the subject as being a lie detector." Given the fact that the NAS also made statements indicative of the opposite, such as "The polygraph is the best-known technique for the psychological detection of deception.", I would fathom this as nothing more then wishful ideate.
[This message has been edited by J.B. McCloughan (edited 10-29-2002).] IP: Logged |
polyops Member
|
posted 10-29-2002 07:54 AM
Please don't take this the wrong way, J.B., but am I the only one who thinks the anti site is overrated? I mean, its okay for entertainmet purposes, but at the end of the day, its still small beer and nothing to get our knickers in a knot over.The powers that be don't pay any attention to antipolygraph.org. The real danger politically is the NAS report. IP: Logged |
J L Ogilvie Moderator
|
posted 10-29-2002 08:03 AM
Just a brief note to your initial post. I think you have a good idea and I will be happy to participate. I do think it should be one person doing the posting on the anti-site and that they should post potential rebuttals here first for all to see and agree or disagree. I have no problem with you or Ed being that person.Due to lack of time I will try to give my input on your last post later. ------------------
IP: Logged |
polyops Member
|
posted 10-29-2002 08:07 AM
There is one thing on the anti site that maybe we could turn around and surprise them with. They keep making a big deal about their countermeasure "challenge." What if a working group were put together from the APA to publicly take them up on it, using the most experienced LE examiners? If we could do this, it would provide just the kind of media boost we need, and put the Maschkes and Williamses of the world out of business.IP: Logged |
ebvan Member
|
posted 10-29-2002 10:11 AM
I am concerned that by taking up this challenge we legitimize what they are doing. We aren't going to change the minds of the guys running these sites. To engage in this type of competition would undoubtedly educate them into the methods used to detect countermeasures. At this point these guys are by and large excluded from cutting edge polygraph techniques in use which is why they keep filing FOIA requests with the CIA and DODPI. I see know reason to help educate them just to prove a point. I say if you catch a subject using countermeasures and can get him to admit which book he bought, encourage him to write a refund request. I KNOW they have received them before, but you won't see them posted on their website.
------------------ but then, that's just one man's opinion
IP: Logged |
polyops Member
|
posted 10-29-2002 10:37 AM
Well, as I understand it, we don't have to disclose HOW we detected the countermeasures --- we just have to DO it. Far from legitimizing them, it will publicly discredit them.I fully agree with you that we are not going to change the minds of the yoyos running the anti sites, but that doesn't matter: we'll change the minds of the otherwise unsuspecting public who visit those sites AND the policy makers who control the purse strings in Washington and elsewhere. IP: Logged |
egelb Member
|
posted 10-29-2002 09:42 PM
I wish it was that easy. The group the NAS put together IS impressive. Say what we will the people who control the purse strings WILL listen to the likes of Ekman, Richards and the heavyweight PhDs that spent two years on the project. If DOE didn't want to hear what the folks said why did they commission the project? I think we know anecdotally that what we do works but that doesn't cut the mustard in the scientific community. APA said that NAS chose 57 or so studies out of 1000 and hung their hat on those. It is up to the academic community the APA relies on to refute the NAS position or show that studies that met the NAS criteria do show validity etc. All of this costs money and without the private sector users of yesteryear (before EPPA) the money just isn't there for the studies. The government will have to foot the bill if they want to continue using the process. I refer to "screenings." Sex offender testing will be the next target when the civil liberty attorneys get their act together. You can say you heard it here first. Ed GelbIP: Logged |
lielabs Moderator
|
posted 10-30-2002 12:52 AM
JB,I agree with ed it seems the only arguments that will be taken seriously by the powers that be are those made by people qualified to do so. Phd's etc in the polygraph community are the ones that will be heard Matte,Honts,Raskin etc have done this in the past to combat the Lykkens and currently Iacano (lykkens student) ideas. Although people like Drew Richardson on anti polygraph when pressed on the issue of specific incident testing do agree it has value (unlike lykken), while the Maschkies like to portray absolute 0 validity with screening and specifics. So there is some disagreement amoung the posters on the anti site. Who has more credibility Richardson and ex FBI polygraph researcher or maschke an anti polygraph web site host. The same logic applies to us. I did post at length on no polygraph and started again on anti polygraph and proved that not all the stories posted on that site are factual (see my conversation with beechtrees). But at the end of the day nothing changes. However as far as the NAS findings go that is were our focus should be. Providing solid answers to the questions they raise by those qualified to do so. IP: Logged |
polyops Member
|
posted 10-30-2002 02:42 AM
I agree we need the PhD's on our side to take the lead. How many are on this site? Maybe more could be persuaded to join. In the War of the Websites, they could even take the battle to the antis, like Gordon Barland has courageously done in the past.I agree that people like Drew Richardson are a lot more credible than those like Maschke. That's why I think beating them at their own countermeasure challenge would have a very good public relations benefit in discrediting one of there top people. The "challenge" is Richardsons, not Maschke's. He even did a cutsie little recording on the antipoly website. I think we could get a lot of mileage out of publicly calling his bluff. IP: Logged |
J L Ogilvie Moderator
|
posted 10-30-2002 08:56 AM
polyops, explain to me what exactly this challenge is. I like your enthusiasm and drive. I hope you belong to ASTM and if you don't why not.Think about this. The studies I have read about counter measures seem to indicate that a subject with good instruction and access to a polygraph instrument for practice can make it difficult for an examiner to detect. We would do considerable harm to our profession if we failed the challenge. I think we have much more to lose. Now if you want to send Don Krapohl to accept the challenge and perform a guilty knowledge test it might open some eyes. At this point I think the negatives might outweigh the positives. ------------------
IP: Logged |
polyops Member
|
posted 10-30-2002 09:08 AM
Dear Mr. Ogilvie,This "challenge" is posted on the anti site at this address -- http://antipolygraph.org/cgi-bin/forums/YaBB.pl?board=Proc&action=display&num=10122364 18 (I hope that works, I'm new to posting links). Youre right of course it would be very bad if it didn't work, but why shouldn't it? Just to be safe, an in house practice test could be done before saying a word in public. No, I'm not in ASTM, but I applaud your efforts. Unfortunately my work makes any such associations problematic at best until I retire, but I'm very grateful to Mr. Hilliard for making this private forum available to us and wish to contribute what I can.
[This message has been edited by polyops (edited 10-30-2002).] IP: Logged |
polyops Member
|
posted 10-30-2002 09:35 AM
One more thing! A little bit of PI work on the side could give us an edge. Hey, all's fair in love and war. ------------------ It's a thankless job, but somebody's gotta do it.
IP: Logged |
J.B. McCloughan Administrator
|
posted 10-30-2002 11:28 PM
Although I agree with the notion that the doctoral ranks amongst us are an important element to our scientific advancement and acceptance within the academic community, I disagree with the notion that those whom hold a high academic title are the only persons the powers that be give credence to. Doug Williams surely had no such credentials when he spearheaded what we have come to know as the OTA report of 1983. This is a man who by no means is as educated or articulate as George Maschke. He did not have as an astute cornerstone club aiding his cause either. Then there is George Maschke. He has a masters in foreign language and is working on his doctoral dissertation in Persian. Maschke’s oral arguments against polygraph screening are available on the NAS site as well as his own. If you have not already listened to them, I suggest you listen to them. If you have listened to them, listen to them closely again. He is very much as articulate as Richardson on the topic. The NAS seemingly gave much credence to his assertions. He sits at a virtual round table with the likes of David Lykken, John Furedy, Bill Iacono, Drew Richardson, Gershon BenShaker, etc… I do not think it is who we send to debate but how and what we choose to debate that will immanently shape the outcome. Arguments of authority, like those that are based on one’s academic credentials or personal experiences, have little to no value when pitted against research data that supports otherwise. It is true that one most certainly can make research data what they want to make of it. However, the NAS review panel was comprised of highly renowned individuals from every field of relativity and that had no stake in the results of the findings. The promulgation of logistic and deductive reasoning that is supported by valid research is what I believe the whole of the sums is in its simplest of form. That is how I see us enabling ourselves to further any positive stance we may have. On to the topic of suggested research by the NAS. The NAS suggested research that is, "…administered by an organization with no operational responsibility for detecting deception and no institutional commitment to using or training practitioners of a particular technique." Later they make note of the DoDPI’s accomplishments but seemingly overshadow it with references to existent conflicts of interest. They then define their idealistic vision of what type of an organization(s) would be most suited to carry out further research. "The organizations that carry out the expanded research program should support both basic and applied research. They should follow standard scientific advisory and decision-making procedures, including external peer review of proposals, and they should support research that is conducted and reviewed openly in the manner of other scientific research."
IP: Logged |
polyops Member
|
posted 11-03-2002 04:51 AM
If you've been following the anti site's message board, you'll see some pretty nasty comments being exchanged. While the antis deserve much of the heat they've been getting I think as professionals we should avoid such exchanges.[This message has been edited by polyops (edited 11-03-2002).] IP: Logged |
J.B. McCloughan Administrator
|
posted 11-03-2002 09:37 PM
I hope that the exchanges of late are not that of any polygraph examiner(s). My intuitions lead me to suspect these antics to be a ploy by one or more persons(anti) to create conflict, due to the substantial reduction of pro-polygraph contributions for them to 'pick at', to draw some unsuspecting examiner into these discussions. I agree with polyops that we should obviously abstain from such childish stratagem. However, I think that someone should post a single detractor to cover the disdain for these actions by true professionals.
IP: Logged |
polyops Member
|
posted 01-23-2003 08:12 AM
J.B.,There is a new discussion on the anti site that insinuates that Dr. Ed Gelb's PhD is from a diploma mill. I don't want to cast any stones, but it's looking more and more believable that this is the case. I posted a message about this a few days ago, hoping that someone who knows Dr. Gelb (I know him only by reputation) would come to his defense. So far, only one examiner has, but she didn't lay the questions to rest. Worse still, an examiner who styles himself as "Batman" viciously attacked Dr. Gelb. What I think is important to do is: 1 - to get to the truth of the matter about Dr. Gelb's degree 2 - if he has been falsely accused, to set the record straight 3 - if the accusations are true, to decide how best to respond. Dr. Gelb is an APA past president, and the antis will be trying to make hay out of this if true ------------------ It's a thankless job, but somebody's gotta do it.
IP: Logged |
J L Ogilvie Moderator
|
posted 01-23-2003 04:45 PM
Ed, what do you think? Do you need to or want to respond to these comments?I personally am not sure that we have to defend or try to prove or disprove everything said by the "anti's" Jack ------------------
IP: Logged |
polyops Member
|
posted 01-24-2003 10:20 AM
Jack,I fully agree with you that there's no need to respond to everything put out by the anti's. But look at the new attack on the anti site main page, and read the posts on the link with Dr. Gelb's picture.I think some kind of response would probably be best in this particular case. Dr. Gelb? ------------------ It's a thankless job, but somebody's gotta do it.
IP: Logged |
J.B. McCloughan Administrator
|
posted 01-24-2003 11:16 AM
polyops,I do not think that this is something that we need to respond to the anti site about. They are rather efficient at attempting to goad people into responding. We just add fuel to their fire. I am most certain that Ed will respond when and where he deems it appropriate and beneficial.
IP: Logged |
detector Administrator
|
posted 01-24-2003 12:00 PM
Hey J.B.,I think what you said here hit the heart of the issue. The anti site folks don't really care about right and wrong, just that they stir controversy. They are nothing more than the Jerry Springer of Polygraph. In my opinion, If someone is specifically concerned about Ed's credentials, email him and ask him, his email address is posted here. Just click on the little little icon of the face with a question mark beside his post and his email is there. I do however like mirroring the discussions. One tip. When you break from the topic of discussion, such as when Polyops posted the info about Ed on anti site. Put that in a new topic so it is easier to get to rather than scrolling down through all the old postings. ------------------ Ralph Hilliard PolygraphPlace Moderator http://www.wordnet.net
IP: Logged |
polyops Member
|
posted 01-24-2003 12:24 PM
J.B., Ralph,I agree that the anti's are looking to stir up controversy. And I fully agree that Dr. Gelb will know best how to respond to this. But I am concerned because the questions about Dr. Gelb's credentials seem plausible, and Dr. Gelb's silence doesn't portend well. If his PhD is legit, why not simply say so? This would take the wind out of the antis' sails. Most importantly, I am concerned that we as a community may end up with egg on our face if no effective response is made. ------------------ It's a thankless job, but somebody's gotta do it.
[This message has been edited by polyops (edited 01-24-2003).] IP: Logged | |